Skip to content

Conversation

twoertwein
Copy link
Member

@twoertwein twoertwein commented Jan 24, 2021

I don't know why the change from #37056 fails in combination with protocol=5 and compression. @ig248

An alternative fix would be to have get_handle insert a write buffer for all compressions (similar to #38728) to avoid if/else in format specific to_*

@twoertwein twoertwein added the IO Pickle read_pickle, to_pickle label Jan 24, 2021
@jreback jreback added this to the 1.2.2 milestone Jan 24, 2021
@jreback jreback changed the title REGR: wirte compressed pickle files with protocol=5 REGR: write compressed pickle files with protocol=5 Jan 24, 2021
@jreback jreback merged commit 5c2fb96 into pandas-dev:master Jan 26, 2021
@jreback
Copy link
Contributor

jreback commented Jan 26, 2021

thanks @twoertwein

@jreback
Copy link
Contributor

jreback commented Jan 26, 2021

@meeseeksdev backport 1.2.x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
IO Pickle read_pickle, to_pickle
Projects
None yet
Development

Successfully merging this pull request may close these issues.

BUG:to_pickle() raises TypeError when compressing large dataframe
3 participants